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We discuss some natural maps from a unitary group U(n) to a smaller group U(n — m) (these 
maps are versions of the Livsic characteristic function). We calculate explicitly the direct images 
of the Haar measure under some maps. We evaluate some matrix integrals over classical groups 
and some symmetric spaces (values of the integrals are products of T-functions). These integrals 
generalize Hua Loo Keng integrals. We construct inverse limits of unitary groups equipped with 
analogues of Haar measure and evaluate some integrals over these inverse limits. 



Let K be the real numbers R, the complex numbers C or the algebra of quaternions H. By 
U(n, K) = 0(n), U(n), Sp(ra) we denote the unitary group of the space K n = R n , C", H". We also will 
use the notation 



for the connected component of the group U(n, K). 

By a n we denote the Haar measure on U°(n,K) normalized by the condition er n (U°(n, K)) = 1. 

Let Q be a matrix over K. By [Q] p we denote the left upper block of the matrix Q of size p x p. 
By {Q} p we denote the right lower block of size p x p. 



Let us represent a matrix g 6 U°(rt, K) as a (m+(n— m)) x (m+(n— m)) block matrix 



Abstract 



To memory of Sergei Kerov 



U°(n,K) :=SO(ra), U(n), Sp(n) 




Consider the map 




(this map is defined almost everywhere on U°(n, K)). 



Proposition O.l(Q) a)T m maps U°(n,K) to V°(n-m,K). 
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C ) S = f+T i m P l i es {S} P = T"-r(g)+i 

Remark. It is clear that the map T m is not a homomorphism U°(n,K) — > U°(n — m,K). It is, 
however, a morphism of symmetric spaces in a sense explained in fl6|| . □ 

Remark. Note that T m is a value of the Livsic characteristic function 

X (\) = T + \R(l-\P)- 1 Q 

at A = —1 (see and Proposition 0.1 is quite a standard claim from this point of view. Characteristic 
functions were widely exploited for studies of spectral properties of an individual operator (see ]2^] ) . 
Nevertheless, it seems that until [jl9| they have never been used in analysis on unitary groups. □ 

Remark. The statement c) means the following. For a matrix g S U°(K) consider its Cayley 
transform (1 — g)~ l (\ + g). Then we consider the inverse Cayley transform of the right lower block of 
(1 — g) _1 (l + g). The result coincides with the application of the map T to g. □ 

In Section 1 we investigate some properties of the maps T m . We construct maps from the groups 
U° (n, K) to some spaces (groups of lower dimension, cubes, products of matrix balls, etc.) and calculate 
explicitly the images of the Haar measure under these maps. 

We also consider the following measures on the groups U°(n,K) 

n 

[] | det(l + [g] n ^ k+1 )\ x "- x "-'da n (g), (0.1) 

k=l 

(we assume Ao = 0). We show that the image of such a measure with respect to the map T 1 coincides 
with the measure on U° {n — 1 , K) given by the formula 

n-l 

C(A) J] | det(l + [h] n - k )\^-^dcr n -i{h), 

k=l 

where the value C(A) is explicitly evaluated (Theorem 1.5). 

This observation makes it possible to obtain pleasant explicit formulas (2.1)-(2.3) for the integrals 
of the functions (0.1). For instance, in the case IK = C we obtain 

/ f[ (det(l + \g] n - k+1 ) x --^- Metd + ^^r^- 1 } da n (g) = f[ 

iu(n) 1 J £Ji r ( fc + A fc )r(fc + H k ) 

In the case A x = • • • = A n = JT[ = ■ ■ ■ = we obtain one of Hua Loo Keng's integrals (0), Chapter 
2). In Section 2 we also discuss other matrix integrals. 

In Section 3 we construct inverse limits of the unitary groups (virtual unitary groups) and give 
some remarks on these limits. Virtual unitary groups are close to Pickrell's virtual Grassmannian (see 

see also Shimomura's paper (27) ) and to Kerov-Olshanski-Vershik's virtual permutations (Q). 
Explicit Plancherel formula for the virtual unitary groups is obtained in recent works of Borodin and 
Olshanski @, [| and ||. 

Another application of our integrals is a separation of spectra in analysis of Berezin kernels (pl[. 

11)- 

I thank G.I. Olshanski for discussions of this subject. I also thank the referee of the paper for his 
comments. 



1. MAPS T m AND PROJECTIONS OF MEASURES 
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1.1 Proof of Proposition 0.1 

First we prove c). We use the following Frobenius formula (see (§], Section II. 5) for the inverse of a 
block matrix 









(c 


I) 





(1.1) 

(1.2) 



' A- 1 + A~ l B(D - CA- 1 B)- 1 CA- 1 -A- X B(D - CA~ X B)- X 
—{D - CA~ 1 B)~ 1 CA~ 1 (D-CA^B)- 1 

(A- BD^C)- 1 -(A- BD^C^BD- 1 

-D- X C(A - BD^C)- 1 D- 1 + D- X C(A - BD~ 1 C)~ 1 BD~ 1 

We have S = — 1 + 2(1 and formula (1.1) implies 

{S} p = -1 + 2(1 + T - R(l + P^Q))- 1 = -1 + 2(1 + T"-^))- 1 . 

The statement b) is a consequence of c). 

The condition g £ U°(n, K) is equivalent to the condition S + S* =0. This implies a). □ 
Remark. A proof of Proposition 0.1 which does not require any calculations is contained in ]19| . 

1.2 Projection of the Haar Measures 
Lemma 1.1. Let A, B e U°(n - m, K). Then 



1 \ / 1 
A g \ B 



AT m (g)B. 



PROOF. Obvious. □ 
Corollary 1.2. The image of the probability Haar measure o~ n on U°(n, K) under the map 
T m : U°(n,K) -> U°(n - m,K) is the Haar measure a n - m - 

Proof. Indeed, the image is the probability U°(n — m, K) x U°(n — m, K)-invariant measure on 
U°(n-m,K). □ 

By B„ = B n (K) we denote a set of all n x n-matrices Z over IK satisfying the condition \\Z\\ < 1 
(here || • || denotes the norm of an operator in an Euclidean space K"). 
Consider a map 

Cm ■■ U°(ri, K) -> \J°(n - m, K) x B m 

defined by 

C m (g) = (T m (g),[g] m ). 

Recall that the map T m is defined almost everywhere. 
Theorem 1.3. Suppose n ^ 2m. Let 

t = (n-2m + l)dimK/2. 

Then the image of the Haar measure cr n (g) with respect to the map Cm is given by the formula 

const • det(l - Z*Zf- 1 dZda n - m (h), (1.3) 

where Z 6 B m , h G U°(n — m,K), and dZ is the Lebesgue measure on B m . 

Remark. Let us recall the definition of the quaternionic determinant. Let g be a quaternionic 
operator H™ — > H". We can consider g as an operator gin : R 4 ™ — > R 4 ™. Then 



detg := ^/detgm- 

The quaternionic linear group GL(n,H) is connected and hence the determinant under the root is 
positive. If g is a diagonal matrix with values di, . . . , a m on the diagonal, then det(g) = Y[ \ a j\- ^ 
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Remark. For a matrix X satisfying ||X|| < 1, the power 



oo 



1=0 

is well defined. Hence, in (1.3) the expression (1 — Z* Z) T ~ X is well defined, hence its determinant also 
is well defined. □ 

Proof. Denote by v the image of the Haar measure on U°(n,K) under the map £ m . Let 
A,B £ U°(n - m,K). By Lemma 1.1, 



1 \ / 1 
A 9 \ B 



= (AT m (g)B,[g} m ). 



Hence, the measure v on U°(n — m,K) x B m is invariant with respect to the transformations (h, Z) 
(AhB,Z). Thus, v has the form <p(Z) dZ d<j n - m (h) , where <p(Z) is a function on B m . We want to 
calculate <p{Z). For this purpose, we project the measure v from U°(n — to, K) x B m to B m . Obviously, 
the image of v under this projection has a form const • f(Z) dZ. 

Consider the simplex E m C K m defined by the inequalities 1 ^ r\ . . . r m ^ 0. Each point Z 
of the matrix ball B m can be represented in the form 



Z = qi 



■ q 2 ; where qi,q 2 £ U°(m,K), (ri, r 2 , . . . ) £ E r 



r2 

v ■•• y 

Obviously, the numbers rj are uniquely defined by the matrix Z. 

To evaluate the density (p(Z) = ' plyZ d > z dZ we project both measures <p(Z) dZ, dZ to the simplex 
E m . The projection of the measure ip(Z) dZ to S m coincides with the projection of the Haar measure 
from U°(n, K) to E m . The latter projection is the radial part of the Haar measure on U°(n, K) with 
respect to the symmetric subgroup U°(to, K) xU°(n-m,K). An explicit formula for the radial part 
(see |l(J, X.l) is given by: 

const- JT (l_ r 2)((n-2m+l)dimK-2)/2| ~Q _ ^jdimK JJ r di mK -l dr \ (14) 

It is easy to calculate the projection of the Lebesgue measure dZ to E m (see calculations of this 
type in [l2| , chapters 2-3). This projection coincides with the expression in the curly brackets in (1.4). 

It remains to observe that the function det(l — Z* Z) is U°(to,K) x U°(to, K)-invariant, and its 
restriction to the simplex E m equals Y\(l — rf ). □ 

The measure (1.3) have to be a probability measure, and hence the constant in (1.3) is inverse to 
the following value (t) . 
Lemma 1.4. For r > 0, 

J.m) ( ^._ f 7*^T-l^_^m 2 dimK/2-fT T(t + (j - 1) dim K /2) 

'-■'IK 



n lit, 

\t):= / dct(l- Z*Zf- l dZ = IT" 1 ' ^dimK/2-Q 



L r(r + (to + j - 1) dimK/2) ' 

In this formula, we use the simplest normalization of the Lebesgue measure dZ. If K = K and z a @ 
are the matrix elements of Z, then dZ := J| dz a p. For K = C, we represent matrix elements in the form 
z a /3 = u a p+iv a p, and assume dZ :— Y[ du a fjdv a p. For K = H, we write z a p = Uap+ivap+jwap+khap, 
and assume dZ = du a p dv a p dw a p dh a fj. 

Remark. In particular, in the case to = 1 the normalizing constants in Theorem 1.3 are 
a) forK = M: 7r- 1 / 2 r(n/2)/r((n - l)/2); 
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b) forK = C: (n-l)/iv; 

c) forK = H: (2n - 2)(2n - 1)/tt 2 . □ 
Proof. In principle, these integrals were evaluated by Hua Loo Keng. But he considered only 

case IK = C. Obviously, his method also is quite valid in two other cases. To avoid calculations, we 
give a reduction to the Selberg integral. 
Denote 5 = dimK. By (1.4), 

1 l 

c^\r) = C(m,S). [■..[ J] (1-rfr 1 U (r? - rj) S [] rf" 1 [] 







where C(m, <5) is a constant which does not depend on r. We substitute Xj = r| and apply the Selberg 
integral (see |2|) 



/••■/ n i*-*^ n {•'•■; 1 ^ '} n 

=n 

This gives 



T(a + (j - 1) 7 ) T(/3 + (j - 1) 7 ) r(l + 31) 
,. =1 r(a + /3 + (n + i-2) 7 )r(l+ 7 ) ' 



c (-) frl _ ± C (m S) TT r(r + (j-lW2)r(j^/2)r(l + ^/2) 
^ W-^'^ll T(r+(m + j-l)S/2)T(l + S/2) ' 

To find the constant, we obtain the asymptotics of c^(t) as r — > +oo in two ways. First, we 
apply the formula 

T(a + x)/T{b + x) ~ x {a ~ b \ x^+oo, 

and obtain 

2 m v ; Al r(l + (5/2) 
Applying the Laplace method (see, for instance, @), we obtain 

4 m) (r):= J det(l - Z*Z) T - 1 dZ = r- m2s / 2 J det(l - ^Z* Z)^ 1 dZ ~ 

I|Z||<1 ||Z||<Vr 

- r- m2<5 / 2 J exp(-trZ*Z) dZ = T -™ 2 S/2 w m 2 6/2. T _^ +QQ . 

the last integral is taken over the whole space of to x to matrices. Compairing the asymptotics we 
obtain the explicit expression for C(m,5). □ 

1.3 Projection of an Orthogonal Group to a Cube 

Assume K = M. (other cases are similar). Let to = 1 in the notation of Subsection 1.2. In this case, 
the 'ball' Hi is the segment [—1,1]. Consider the iterations of the map £i: 

SO(n) -» SO(n - 1) x [-1, 1] -> SO(n - 2) x [-1, 1] x [-1, 1] -»■ . . . 

We obtain a map 9 (defined almost everywhere) from SO(n) to the cube [— 1, l] n_1 = [—1,1] x • • ■ x 
[—1,1] given by the formula 

(x 2 ,x 3 , . . . ,x n ) = ([T"- 2 ( ff )] 1; . . . , [T 1 ^)]!, [sh). 
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Remark. The map T" _1 maps SO(n) to S0(1). The latter group is a singleton and hence we 
can omit T n_1 from the formula. In the case K = C, we obtain a map from U(n) to S 1 x Bi(C)™ -1 
where Bi(C) is the disk \z\ ^ 1 in C and S 1 is the circle \z\ — 1. In the case IK = H, we obtain a map 
Sp(n) -> S 3 x Bi (H)" _1 , there S 3 is the sphere \z\ = 1 in H ~ R 4 and B 1 (B) is the ball in H. □ 

By Theorem 1.3, the image of the probability Haar measure under our map O equals 

d^ 2 , ..., Xn )= v -^§- na - x ^-w n dXj . 

11 j=2 j=2 

Consider a function / depending of n — 1 variables. Then we have 

f([T n - 2 (g)} 1 ,...,[T 1 (g)} u [g} 1 )d<j n (g)= f f(x 2 ,...,x n )d l ,(x 2 ,...,x n ). (1.5) 

SO(n) ^[-l.l]™- 1 

1.4 Projections of Orthogonal Groups to Products of Matrix Balls 

Let n = p± + • • • + p a + q and pj ^ Pj+i + ■ ■ ■ + Pa + Q for all j ■ Consider a map 

9 : SO(n) -> S0(<7) x B Pq x • ■ ■ x B P1 

given by the formula 

9(. 9 ) = (T"+""*« (<?), [T**+""H*-* Q?)k , . . . , [T P1 ( 5 )] Pa , [ 5 ] P1 ) 
By Theorem 1.3, the image of the Haar measure on SO(n) under the map is 

a. a. 

const • Y[ det(l - ^*^ i )fe+i+-+P«+9-Pi-i)/2 dZj d<7 g (/i), 
where h G SO(<7), S B Pj and the constant is the product of constants evaluated in Lemma 4: 

a 

II C R (^+l + •••+P"-^ + 1 )/ 2 )■ 
.7=l 

1.5 Multiplicativity 

PROPOSITION 1.4. Let g G U°(7i, K) and let m < p < n. Then 

det(l + = det(l + [<?] m ) det(l + [T m (g)}^ m ) 

Proof. Let us represent g as an (to + (p — to) + (n — p)) x (to + (p — to) + (n—p)) block matrix : 

P Qi Q 2 

,g=| i?i Tn T12 

i?2 T21 T22 



By the formula 

K C D 

for the determinant of a block matrix (||, Section II. 5), we obtain 



det ( n n ) = dct (^) dct (-° - CA- 1 ^). 



det 



P Qi 
Ri Tn 



det(l + P) det(l + Tn -i^l(l + P^ 1 Ql)• 



C 



On the other hand, we have 
T m (g) = 



T 11 -R 1 (l + P)- 1 Q 1 T 12 -R 1 (l + P)- 1 Q 2 
T 2 i-R 2 (l + P)- 1 Qi T 22 -R 2 {l + P)- 1 Q 2 



and the statement obviously follows. □ 
Remark. Proposition 1.5 gives an expression of the coordinates Xj on the cube (see 1.3) 

1 , , , r T m/ dct(l + [g] m +l) 

i + Xn . m = i + [ r ( 9)]l = dct(1 + [5k) • 

Also we obtain we identity 

771 

det(l + [ ff ] m ) = n(l + [^- 1 (5)]i). 

1.6 A Consistent System of Measures 

Consider Ai, . . . , A„, /ii, ...,// B gC. Assume A = = 0. 
Theorem 1.6. 

a) Let K = K. Assume Re A„ > — (n— 1)/2. Consider the measure on SO(n) groen 6t/ i/ie formula 

n 

H det(l + [ ff ] n _ fc+1 ) A *- A *- 1 da n ( ff ). (1.6) 
fc=i 

Tften its image under the map T 1 is 



2 r((n-l)/2)r(A„ + n-l)ll dCt(1 + W "- fc) 

b) Let K = C. vlssitme Re (A„ + /i„) > — n. Consider the ( complex-valued) measure on U(n) 
gwen 6y ffte formula 



U det(l + [.g]„- fc +i) Afc - Afc - 1 dct(l + [sk-fc+i)"* dtr„( ff ). (1.7) 



— Mfc — l 

iet(i + ""-^aeni + ^jn-fe+i 

fc=i 

TTien its image under the map T 1 is 



1 ^71 -+- A n Jl ^71 -f- 

c) Let K = M. Assume Re A n > — 2n — 1. Consider the measure on Sp(n) pwen fry £/ie formula 

n 

I] dct (! + Mn-fc+l)^-^- 1 <Mff)- (1.8) 
fc=l 

T/ien its image under the map T 1 is 

n— 1 

Remark. The measure (1.7) is a positive real- valued measure iff Aj = p- for all j. □ 
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1.7. Proof of Theorem 1.6 for K = M 

We apply Theorem 1.3. In our case the matrix ball Bi is the segment [—1, 1] and [g]\ = gu is the left 
upper matrix element of g € SO(n). By Proposition 1.5, we have 



[] det(l + \g] n _ k+1 )>*->*-> = + [gh)^- 1 x I] det(l + [T 1 (.g)]„_ fe ) ; 



L v ^ 1 L A \y ) \ n— k, ) 

k=l Lfe=l ) U=l 



Hence, the projection of the measure (1.6) to Bi x SO(n — 1) is 
I>/2) 



7r 1 /2r((n- l)/2) 



{{l+x^il-x^-V^dx} x (1.9) 



'n-l 



x ^ FJ dct(l + [h] n -k) Xk ~ Xk - 1 da n - 1 {h) \ , where x E [-1, 1], ft e SO(n - 1), (1.10) 



i.e., this projection is a product-measure. Thus, the projection of the Haar measure to SO(n — 1) is 
given by formula (1.10) up to a factor depending on A„. The factor is (to simplify the formula we 
write A instead of A„): 



I>/2) 



7r 1 /2r((n- l)/2) J_ 
I>/2) 



J (1 - a; 2 )("- 3 )/ 2 (l + x) x dx = (1.11) 



9 A+n-2 R . x , n-l n-lN _ oA+n-2 I>/2)r(A + (n - l)/2) 



7r 1 /2r((n- l)/2) v 2 ' 2 > 7rV2r(A + n - 1) 

Applying the duplication formula for T, we obtain the required statement 

1.8 Proof of Theorem 1.6 for K = C 

The proof is similar. In the case K = C, the integral (1.11) is replaced by the integral 



j„(A, M )=/7 (i+p)\i+pr(i-\ P \ 2 r- 2 -dpdp. (i.i2) 



After the substitution p = re %v ,p = re v we obtain 



J n (\,fj,)= dr {l + re^Yil+re-^Yil-r^-^rdip. (1.13) 
Jo Jo 

Expanding two first factors of the integrand into the Taylor series, we get 

J„(A )M ) = jf * dr jT (f: t3± { - r f e A (f2 (=^* (_ r) * e -^ (1 - r»)»" a r^. 
The integration over gives 



f y( (^M^ r 2 fc(1 _ r 2 r2 | rfr 2 

Jo fr I *!*! J 



Finally integrating in r, we get 



J„(A,^ =7 rf: ( A) fc fc ,^ )fc fx\l- X Y-*dx= (1.14) 
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(-A) fc (- /x) fc (n-2)! _ 7T 
fc!(fc 

The application of Gauss' formula 



= 7T > 7777— TTj - T* (-A, lj- 

' fc!(fc + n— 1)! n— 1 



yields 

t a x _ n T(n)T(n + A + n) 
n[,N n-lT(n + X)T(n + pY 

After multiplication by (n — 1)/tt (see the normalization constants after Lemma 1.4) we obtain 
the required statement. 

1.9 Proof of Theorem 1.6 for K = H 

In the case K = H, we obtain the integral 

Jn(s) = 

= f f f f ((1 + h^ 2 + h\ + h\ + hl) X / 2 (l -h\-h\-h\- h 2 4 ) 2n ~ 3 dh x dh 2 dh 3 dh 4 . 

J J J J hl+hZ+hl+hl^l 

(1.16) 

Passing to the spherical coordinates with respect to the variables /12, h$, h 4 , we obtain 
J„(A) = 4tt / /((l + h x f + p 2 ) x ' 2 (l -hi- p 2 ) 2n - 3 p 2 dh X dp, 



where the domain of integration is h\ + p 2 ^ 1, p ^ 0. We can change the integral to the integral over 
the whole circle h\ + p 2 ^ 1 (of course, we must write 1/2 in front of the integral). Passing to the 
polar coordinates hi — r cos ip, p — r sin ip, we obtain 

2n J\r 1^ (1 + re^) x / 2 (l + re-^) x / 2 (l - r 2 ) 2n - 3 r 3 ■ (-^j {e 2i * - 2 + e" 2 ^} dtp. 

Removing the curly brackets, we obtain a sum of 3 integrals. The first and the third integrals 
coincide. We obtain 



„2\2n-3„3 



r 6 dip + 



r\ ,-2tt 

J n (\)=ir dr {l + re^) x ' 2 {l + re-^) x ' 2 {l-r 2 f 
Jo Jo 

p 1 />2tt 

-it dr (l + re lv ) x l 2 {l+re-^) x l 2 {l-r 2 ) 2n - 3 r 3 e 2 ^ dip. 
Jo Jo 

Repeating the calculations (1.13) - (1.14) for each integral, we get 



^ (-A/2) fc+2 (-A/2) fc (2n-l)! ^ (-A/2) fc (-A/2) fc (2n - 3)! 

f--> fc!(2n + fc)! ^ [ ' fc!(2n + fc-l)! 

fc — k — 



= 7T 2 



M^Z + -l F{ - X/2 + 2 ' ^ 2n (2n-l)(2n-2) F( - AA ^ + 

+ 2,(2i: A i)(L2) f( - A/2 + : ' - A/2 +i ' 2n+1 ' 1} 
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Applying Gauss' formula (1.15), we obtain 



7T 2 



(-A/2)(-A/2+l) (2n)!r(2n + A-l) 1 (2n - l)T(2n + A) | 



2n(2n - l)(2n - 2) T(2n + A/2 - l)r(2n + A/2 + 1) (2n - l)(2n - 2) T 2 (2n + A/2) 

(-A/2) 2 (2n)!r(2n + A- 1) 



= 7T 



2n(2n- l)(2n- 2) T 2 (2n + A/2) 
2 (2n-3)!r(2n + A-l) 



(-A/2)(-A/2 + l) 2n + A-l (-A/2) 2 



2n + A/2 2n + A/2 - 1 2n + A/2 - 1 



T(2n + A/2- l)r(2n + A/2) 
Finally, we obtain 

2 (2n-3)!r(2n + A + l) tt 2 (2n - l)T(2n + A + 1) 



MX) = r 



T(2n + A/2)r(2n + A/2 + 1) (2n - l)(2n - 2) T{2n + A/2)r(2n + A/2 + 1) 



Now we have to repeat all calculations for the case n = 1 . In the case K = C wc have an integral 
over the circle |p| = 1, in the case K = H we obtain an integral over the sphere /i 2 + h\ + fo§ + h\ = 1. 
We omit these calculations. 

1.1Q Another representation of the densities. 

For definitencss, consider the case K = M. Multiplicativity theorem 1.5 shows that the density (1.6) 
can be represented in the form 

f] det(l + [gU-k+i)^- 1 ■ da n (g) = f[(l + [T n - j (g)]i) x > ■ da n (g). (1.17) 

fe=l n j=l 

2. EXAMPLES: CALCULATION OF SOME MATRIX INTEGRALS 

2.1 Some Integrals over Classical Groups. 

Theorem 1.6 immediately yields 

Corollary 2.1 Let A = fio = 0. Then 

! TTdetU + M ^. )>■->- daM-U ■>>- - ' )r(At + (t - 1)/2) - (21) 

L 2 det(1 + M "-' +,,i '" x '"' det(1+l *-' + ' ) """"' ** to) - S i^Si 

/ SpW n + *.<,) - n r(2t ^+^ +1) - m 

77ie integrals are absolutely covergent under the following conditions 

a) in the real case: Re A^ > —(k — l)/2, 

b) in i/ie complex case: Re (A& + /i^) > —A: 

c) in the quaternionian case: Rc Afc > — (2k + 1) 
for all k. 

Remark. Let g e SO(n). Then 

det(l + [<?]„_!) = det(l+ 5 )/det(l + [T"" 1 ^!) 



(2.2) 
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But T n ^ 1 (g) G S0(1) and hence it equals 1. Thus 

det(l + [g]n-i) = ±det(l+.g). 

By this reason, the integral (2.1) depend on Ai in a nonessential way. □ 

Remark. The absolute convergence of the integrals (2.1)-(2.3) follows from the absolute conver- 
gence of the integrals (1.11), (1-12), (1.16). Absolute convergence of the former integrals is a simple 
exercise. □ 

The formulas (1.5), (1.17) imply a more general (and more artificial) statement. 

Corollary 2.2. Let A = ^ = 0,#i = 0. Then 

I f] det (! + Mn-k+i)^"- 1 f[(l- \[T n - k (9)}i\ 2 P /2 da n (g) = (2.4) 
= I>/2) yr Afc+fc+gfc _ 2 r((fc + 9 k - l)/2)r(A fc + (k + 9 k - l)/2) 

W 2 W T(\ k + k + e k -i) 

/n n 
det (! + [.9]n-fe+i) A ^ Afc - 1 det(l + [gjn-kf"^- 1 - \[T n - k {g)]^ da n {g) = (2.5) 

J (") fe=l fc=2 

= -A- r{k + e k - i)v(k + e k + x k + n k ) 
M r(fc + fe + A fe )r(fc + ^ + Aife ) ' 

/ n ^ + ri( i - i[T"- fe ( 5 )]ii 2 ) 20 ^^(.9) = (2.6) 

Js P(«) fe=l fe=2 

, 2 -pr r(2(fc + g fc ~i))r(2(fc + g fc ) + A fc + i) 

1 " j - 11 r(2(fc + 9k) + A fc /2)r(2(fc + 9 k ) + X k /2 + 1) ' 
Proof. Consider the case K = R. By 1.10, the integrand in (2.4) has the form 

n 

J](i + [r n - j (g)]i) x * • (l - |[T- fc (5)]i| 2 )^ /2 

Thus, the integrand is a function in the variables Xj = [T n_J '(j)]i. Applying the formula (1.5), we 
reduce the integral to the form 

/ . . . / na + na - w«>-*>'* n **■ 

This integral is reduced to (1.9). 

In the cases K = C, H, we obtain the same reduction to the integrals (1.12), (1.16). □ 



2.2 Some Integrals over Stiefel Manifolds 

Recall that a Stiefel manifold Sti(m, n, K) = U° (n, K) /U° (n — to, K) is the set of isometric embeddings 
K m — ► K n . A projection from a group U°(n,K) to a homogeneous space Sti(m, n, K) is very simple: 
we take a unitary matrix and delete its last n — to rows. 

Assume A = ••• = A„_ r „ = 0, /Uo = •■■ = Mn-m = in the integrals (2.1)-(2.3). Then the 
integrand depends only of the first to rows of a matrix. Therefore, we can consider the integral as an 
integral over the Stiefel manifold Sti(m,n, K). 
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2.3 Some Integrals over Matrix Balls 

As in Subsection 1.2, we denote the matrix ball by B m (K). Let dZ be the Lebesgue measure on B m (K) 
normalized as in Lemma 1.4. 

Proposition 2.3 

TCI 

det(l - z* Z )(«-m-i)/2 -Q dct ^ + [z] m _ k+1 )^-^-idZ = (2.7) 
fe=i 

C"0|Y ,^ w TT r (H a - l)r(A fc + (a + k - l)/2) 

= c R ((a - m + l)/2) II ~ ~ _ 1)/2)r(Afc + a + k _ iy ( 2 - 8 ) 

k= 1 

/ det(l - Z*Z) Q -'» J] {det(l + [Z] m - k+1 ) x -- x -^dct(l + [Z] m _ fc+1 ) Mfc " Mfc } dZ = (2.9) 



L 



! • k =i 

>0 



/ , 1 \ TT r ( fc + ")r(fc + a + A fe + /ifc) 
a-m+lll — — ■ -: 

^ r(fc + a + Afe)r(fc + a + fi k ) 



/ det{l-Z*Zf^- m ^ 1 T\d C t(l + [Z] m ^ k+1 )^- x ^dZ= (2.10) 
^B m (H) fc=1 

- (™W _ i 1 \\ TT L(2(fc + Q ))r(2(fc + a ) + A fc + l) 

11 m JJ M r(2(fc + a) + A fe /2)r(2(fc + a) + A fe /2 + l)' 

where the constants CjT* (•) are t/ie same as m Lemma 1.4. 

Proof will be given in the case K = M. Consider another parameter (3 = a + m. First let /3 be 
an integer, /3 > 2m. Consider the integral (evaluated before, corollary 2.1). 



„( m ) 

MB 



« m 

((/3-2m+l)/2) / TTdet(l + [ 5 ] m _ fc+1 ) A *- A *- 1 ^( 5 ). (2.11) 

JSO(/3) fc _ n 



The integrand depends only on the matrix [g] m £ B m . Hence, we can consider the integral as an 
integral over B m . Using Theorem 1.3, we convert (2.11) to the form (2.7). 

Thus, the required statement is proved for the integer values of a > m + 1. 

Fix 

Ai > A 2 > ... > A m . (2.12) 

Then, for Re a > m + 1, the left side of the integral is a bounded holomorphic function in a in the 
domain Re a > m + 1. Indeed, det(l — Z* Z) ^ 1 for Z £ B m and thus the integrand (for fixed Xj) is 
bounded. 

It can easily be checked that the product of T also is bounded in the same domain. By the Carlson 
theorem^ the left part (2.7) and the right part (2.8) coincide in the whole domain Re a > m + 1. 

The analytic continuation allows to omit the condition (2.12). □ 

2.4 Some Integrals Over Spaces of Anti-Hermitian Matrices 

Let us change the variable g = — 1 + 2(A+1)~ 1 in the integral (2.1). Obviously, A is a skew-symmetric 
matrix. Let us calculate the new integrand. We represent g as a (m + (n — m)) x (m + (n — m)) block 

matrix g = ( ^ ^ )• By Proposition 1.5, we obtain 



R T / 

det(l + [g] m ) = det(l + P) = det(l + g) ■ det (l + T — R(l + P^Q)" 1 . (2.13) 



1 I{ f(z) is holomorphic and bounded for Re z > and if f(n) = for all n = 1, 2, . . . , then f(z) = 0, see, for instance 
, Theorem 2.8.1. 
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Further, 



2(1 +Jf)- 1 = l + g = l+ ( P R % 



Hence, the expression det(l + g) transforms to const • det(l + X) 1 . The Frobenius formula (1.1) gives 
2(1 + X) = (1 + a)- 1 = 2 | , ;" , . N _i ) (2.14) 

1 y ^ y> \ ... (i + T-i?(i + p)- 1 o) y 17 

(we only write the block which is interesting for us). Therefore, by (2. 13), (2. 14), the expression 
det(l + [g] n -k+i) converts to the form 

const • det(l + {X} fe _i) ■ det(l + X) -1 

(according to the notation of Subsection 1.1). 

The Jacobian of the transformation g = — 1 + 2(X + 1) _1 equals const • det(l + X)^™ -1 '/ 2 (see 
[l2| , §3.7) and, finally, the integral transforms to the form 

const • / Y[ (det(l + [Xjk-i)^-^- 1 ) det(l + X)- x ^ n ~ l ^ 2 dX, (2.15) 

•* k=2 

where the integration is taken over the space of real skew-symmetric matrices. 

In the same way, the integrals (2.2)-(2.3) transform into integrals over the space of anti-Hcrmitian 
(X — —X*) matrices over C or EL For instance, in the complex case we obtain an arbitrary integral 
of the form 

« n 

/ TTdet(l + [X] fc ) afc det(l-[X] fe ) fcfc dX (2.16) 

Jx+x*=o fc=1 

2.5 Some Integrals over Spaces of Dissipative Matrices 

Let us transform the integral (2.7) as in Subsection 2.4. It can easily be checked that 

„ , det(2(X + X*)) 

the Jacobian is given by 

dZ = {i + xy 2m dx, 

and the integral (2.7) transforms to 

const • / detpf + x*) {a - m -^l' 2 J[ (det(l + [X]^"-^- 1 ) det(l + X)- x ™- a - m+1 dX, (2.17) 

k=l 

where the integration is taken over the space of real matrices T satisfying the condition: the matrix 
T + T* is positive definite. 

The integrals (2.9)-(2.10) can be transformed in a similar way. 

Remarks, a) The integral (2.17) and the Cayley transforms of the integrals (2.9), (2.10) are 
partial cases of the matrix B-function introduced in (this B-function extends Gindikin's B-function, 
see ||, fll]]). The Cayley transform of (2.9) is also one of Upmeier-Unterberger integrals, [^9), see also 

' i-i 

b) A way of separation of variables described in Jl8| also allows to evaluate the integrals (2.15), 

(2.16) but they were not evaluated in that paper. The integral (2.16) can also be evaluated using the 
inverse Laplace transform in a way explained in fll|l (but it was not evaluated in this book). The 
integral (2.1) was evaluated and the integrals (2.2)-(2.3) were announced in JTsf| . 

c) Calculations in this paper are almost verbal (except local difficulties in 1.9), and they provide 
an explanation for the existence of explicit formulas. □ 
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3. INVERSE LIMITS OF ORTHOGONAL GROUPS 



In order to be concrete, we consider only the case K = R. 



3.1 Inverse Limit of Orthogonal Groups 

Consider a chain of the maps (defined almost everythere) 

•••^ L SO(fc)i L SO(£; + l)^ L SO(fc + 2) ' (3.1) 

Let us fix a sequence of real numbers Ai, A2, . . . satisfying the condition \ k > — (k — l)/2. Consider in 
each space SO (A:) a probability measure with the density 



C(Ai, . . . , A„) _1 J] det(l + [g] n - k+ i) x "- 



k=l 

with respect to the Haar measure. The constant C(-) is given by (2.1). By Theorem 1.6, our measures 
are consistent with the maps T 1 . Therefore, by the Kolmogorov's theorem about inverse limits (see for 
instance ps|]), we obtain a canonically defined measure on the inverse limit of the chain (3.1). (This 
measure depends on the sequence Ai, A2, ■ ■ •)• 

We denote this inverse limit (equipped with the probability measure) by (Dai,A2,...) ^Ai.a 2 ,...) an d 
we will call it the virtual orthogonal group. 

We also denote by T°° _fc the canonical map 

T°°- k : D Ai ,a 2) ... -» SO(fc). 

This family of measures seems too large. In Subsections 3.4-3.6 we discuss two natural special 
cases. 

Remark. Obviously, the space £)\ lt \ 3> ... is not a projective limit in category of groups. But 
an orthogonal group SO(n) is also the symmetric space G/K = SO(n) x SO(n)/SO(n), where K is 
embedded to G as the diagonal subgroup; the maps T m are quite natural as maps of symmetric spaces 
(see |l(|). Hence D\ lt \ 2l ... can be considered as a projective limit of symmetric spaces. □ 

3.2 Projection of (Da 1 ,a 2 ,...i ^Ai,a 2 ,...) to a Cube 

Consider the product [— 1, 1] 00 of segments [—1,1] equipped with the product of the measures 

2~A-fc+2 



B(A fc + (fc-l)/2,(fc-l)/2) 



(l + x k f*{l-xlf k -V/ 2 dx k , (3.2) 



where fc = 2, 3, 

We define the map {Oxx,X 2 ,...i v Xi,X 2 ,—) ~~ > [ — by the formula 

W ^([T— 2 ( W )h,[T~- 8 (a;)]i,..-). 

Obviously, the image of the measure V\ lt \ Zj ... is our measure on the cube. 



3.3 Quasiinvariance 

Denote by O(oo) the group of all orthogonal operators in the real Hilbcrt space l<i. Denote by SO(oo) fln 
the group of matrices g € O(oo) such that 

a) g — 1 has only finite number of nonzero matrix elements 

b) det( 5 ) = 1 

It is convenient to think that matrices g £ O(oo) are infinite upwards and to the left. We assume 
that the subgroup SO(fc) C O(oo) corresponds to right lower k x k block of infinite matrices. 
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Let A,Be SO(fc). Denote by 1„ the nxn unit matrix. Consider the map T™ : SO(n+fc) — > SO(fc). 
Obviously, 

This yields that for all A, B E 0(oo) fin the transformation 

S i > ASS (3.3) 

of the virtual orthogonal group (0\ ll \ 2t ..., v\ 1 ,\ 2 ,...) is well defined. 

Proposition 3.1. The measure v\ lt \ 2t „. * s quasiinvariant with respect to the action of the group 
SO(oo) fin x SO(oo) fin . The Radon-Nikodym derivative is given by the formula 

[r°°-i(ASB)]i 



._, . [T~-i(S)]i 

Remark. Since A,BG SO(oo) , only finitely many factors of this product differ from 1. □ 
Proof. Let A,B£ SO(fc). Consider the transformation 

of the group SO(n + k). Its Radon-Nikodym derivative is a ratio of densities, and it is equal to 

' i + [r^-H(\^ A )s(\^ B ))] \ Aj 

l + [T"+ fc -J'(S)]i i ' 1 J 

By Lemma 1.1, for j > k 

T"+ fe -((^ o)) = (i V o )TB+ *- J(5)(V o } 

Thus, for j > k we have 

and, hence, the product (3.5) is reduced to 1X7=1 ■ Thus, the Radon-Nikodym derivative of the trans- 
formation (3.4) depends only on X n+k ~ k (S). Hence, the Radon-Nikodym derivatives of the maps (3.4) 
(where A, B G SO(fc) are fixed) form a compatible system of functions with respect to the chain (3.1). 
This implies both statements. □ 

3.4 Hua Pickrell measures 

Let A > —1/2. Consider the probability measure on SO(n) given by the formula 

i/? = C(n, A)det(l+ 5 )\ 

where C(n, A) is a constant. 

This corresponds to the case 

Ai = A2 = • • • = A 

in the construction of Subsection 3.1. Let us denote the inverse limits of the measure spaces (SO(n), f") 
by (0\(oo), v\). We call v\ by Hua-Pickrell measure. 

Proposition 3. 2. a) The measure v\ on Da(oo) is quasi invariant ( in the case A = it is 
invariant) with respect to the action of the group SO(oo) fin x SO(oo) fin . Moreover, for A, B 6 SO(fc) C 
SO (00) the Radon-Nikodym derivative of the transformation S ASB is equal to 

ldet(l + AT ca - k (x)B)^ 



det(l + T°°- fe (x)) 
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b) The diagonal action S ^ A 1 SA of the group SO(oo) fin extends to an invariant action of the 
group 0(oc). 

Proof, a) Let S = ^ J G SO(n + fe). Then the Radon-Nikodym derivative of the transfor- 



mation 



is 



s 



In [l, 

A \ B 



dct 







In 

A 



P Q 



In 

5 



det 




1ft 



p g 

i? T 



A 



det(l + P) A dct(l + ylTB - AR(1 + P)- 1 QB) X det(l + ^T n (5)B) ;> 



det(l + P) x det(l + T - P(l + P)" 1 ^ 



det(l + T"(S)) A 



The Radon-Nikodym derivative depends only on T n (S) G SO(fc) and this implies a). Clearly, a) is 
also a corollary of the Proposition 3.1. 

b) This statement is very simple but its proof uses some technique. By a criterion from p3| , the 
representation of the diagonal group O(oo) fin in L 2 (0\) is weakly continuous. Hence, it extends to 
the group O(oo). The group O(oo) acts by measure preserving transformations and, hence, the group 
O(oo) acts by polymorphisms (see [ fl7| |, chapter 8). But an invertible polymorphism is a measure 
preserving transformation. □ 

Remark. We see that the group of symmetries of the space (Da,^a) is larger than that for a 
general space (Da 1: a 2 ,..., ^a 1: a 2 ,...)- □ 

Remark. Consider the group O(oo) x O(oo) and its subgroup G that consists of pairs (31,32) G 
O(oo) x O(oo) such that gig^ 1 is a Hilbert-Schmidt operator (this is one of Olshanski's (G, K )-pairs, 
see pjj, It is natural to think that our action extends to a quasiinvariant action of G. □ 

Remark. Our construction for A = is the Shimomura construction, ^7j. DPickrell ([p6[) con- 
structed a 1-parametric family of probability measures on inverse limits of Grassmannian U(2n) /U(n) x 
U(n). G.I.01shanski(|2^]) observed that a Pickrell's type construction extends to all 10 series of clas- 
sical compact symmetric spaces (this can be observed from Hua Loo Keng calculations^ , chapter 
2). In particular, it can be carried out for the classical groups U(n), SO(n), Sp(n). Our construction 
of the measure v\ is equivalent to this construction (in the complex case our construction gives an 
additional parameter). 



3.5 Some Integrals over the space (D(oo),i/\) 

Consider the space (D\(oo), v x ) equipped with Hua-Pickrell measure. The construction of Subsection 
3.1 can be considered as a construction of a large family of functions on the space (Da(oo),j/ a ) with 
explicitly computable integrals. 

Let Xj be the coordinates on the cube as in 3.2. 

PROPOSITION 3.3. Consider a sequence Ai, A 2 , • • • G C such thatj^ |Afc— A| < oo 7 \ k > -(fc-l)/2. 

2 In Theorem 2.2.2 of [jl2| Hua exactly claims a projectivity of some system of measures (for noncompact symmetric 
spaces). 
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Let us define the function 3>{Ai, A2, ■ . . }(<^) on 0(oo) by the formula 

00 00 
${Ax, A 2 , . . . }(x) = 2 Al ~ A H dct(l + Xj )^~ x = JJ(1 + [T 00_ ' £ (cj)]i) a ^ 

j=2 fc=l 



llm TZZFi , r^-w.^u ■ ( 3 - 6 ) 



fc^oo det(l + T°°- fc (cj)) A 

Then the limit exists almost everywhere on (D(oo),^ A ) and 

/ 3>{Ai, A2, ...)av =112 — n;oW , — —r — tt- (3.7) 
Jo x (oo) r(A + (fc - l)/2)r(Afc + k - 1) 

Proof. Let us transform the expression (3.6) to the form 



n(i+[T°°^M] 1 ) A 



fc=i 

First, let us prove existence of the functions <&. It is sufficient to prove the convergence 



na+^) Afe - A (3.8) 

k=2 

on the cube [—1, 1]°° equipped with measure (3.2). This is equivalent to the convergence of the series 

oo 

^(A fe -A)ln(l + ^)- (3-9) 

fe=2 

By the Kolmogorov-Khintchin theorem on series of independent random variables (see p8|]), it is 
sufficient to prove the absolute convergence of the series of means and the convergence of the series of 
variances, i.e., 



^C^|(A fe -A) J 1 \n{l+x){l + x) x {l-x 2 ) {k -V /2 dx 
C^\\ k - A| 2 J 1 ln 2 (l + x){l + x) x {l - x 2 )^' 2 dx < 



< oo; (3.10) 



(3.11) 



'-1 

The Laplace method gives the asymptotics Ck = const ■ fc _1 / 2 (l + o(l)) and const ■ £;~ 3 / 2 (l + o(l)) for 
the integrals under the sums (3.10), (3.11). This implies the a.s. convergence of (3.9). 
The product (3.8) is dominated by 



where 

C k = I (l + x) x (l-x 2 )^/ 2 dx. 



II max (C 1 + x k) Xk - X , (1 + x k ) x - x *) ■ (3.12) 



k=2 



By the Lebesgue's theorem on dominated convergence, it is sufficient to prove that the last expression 
is integrable. The integral of (3.12) is 

TT^w a+x k ) lXk - xl (i+x) x a-x 2 )( k - 3 >/ 2 dx+ / (i+x fe )-i A - A ^i(i+x) A (i- a; 2 )( fe - 3 )/ 2 ^). 

fe=2 ^° J ~ l ' 

The Laplace method gives the asymptotics const • /c~ 1 / 2 |Afe — A|(l + o(l)) for the integrals under the 
product, and this implies the required statement. □ 
Remark. Author thinks that condition |Afc — A| < oo is not necessary. □ 
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3.6 Measures on Inverse Limits of Stiefel Manifolds 

Let us fix p > 0. We denote by ipk(g) the function 

det(l + [ 5 ] fe ) A . 

on SO(/c +p). Obviously, the function ^pk{g) is invariant with respect to the action of the group SO(p) 
given by the formula 

9^ ( J ° A )<?; ff eSO(fc + p),AeSO( P ) 

Hence, we can consider the function ipk(g) as a function on the Stiefel manifold (see Subsection 2.2) 
Sti(fc +p,k). Denote by vfc the probability measure on Sti(fc +p,k) with the density const • ipk(g)- 
The projections from the chain (3.1) commute with the action of SO(p). Therefore, we can consider a 



chain of quotient-spaces Sti(fc, k + p) = SO(k + p) /SO(p) equipped with the measures vfc ' 



■■■t- Sti(k,k+p) t- Sti(fe + l,fe+p+l) t- Sti(k + 2, k + p + 2) t- ■■■ 

We denote by (Sti(oo, oo + p), v\) the inverse limit of this chain. Denote by the canonical measure 
on this limit. 

We define the group 0(oo) fin x O(oo +p) iin as the inductive limit of the groups O(fc) x 0(k + p) 
as k oo. 

Proposition 3.4 a) The measure v x is quasi invariant with respect to the action of the group 
O(oo) fin x O(oo+p) fin 

b) The action A : S >— > AS ( ^ J of the diagonal group O(oo) fin on (Sti(oo,oo +p),// A ) 

V I*, J 

extends to an invariant action of the group O(oo). 
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